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Who we are? 


Independent Test Capability (ITC) 

develop, maintain and operate adaptable test 
environments for the IV&V program that enables the 
dynamic analysis of software behaviors for multiple 
NASA missions 




What is Dynamic Emulation? 



Entire Flight “System” condensed to a Laptop 
Sensors/Actuators are Simulated 
Flight Computer Hardware is Emulated. 

Flight Software binaries executed as delivered. 
Ground Operations Integrated. 
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Why we do it... 

Fault Injection 

Flexible Time 

Source Level Debugging 

Measureable V&V 

Unlimited Simulation Resources 
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How we do it... 


Execute 

Emulation software 
assemble engine 

Construct 

Device Modeling Language (DML) 
registers, memory, interrupts, buses 

Connect 

NOS Engine 

ITC middleware product 

Integrate 

Vendor’s models and dynamics 
Ground system software 
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JIST — Project Unique Abilities 

Only integration of Science and Spacecraft FSW 
Faster than real-time 

vf; 

Flexible hardware configurations 
Hardware fault injection 
Source-line debugging 
Complete control of all memory states 
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JIST —Test Cycle 


User-Supplied 
Inputs to JIST 

Flight ITC-Developed JIST Core 

Software 


Spacecraft [ Science 

AAnrlalc I AAr^A^n 



JIST Outputs 


► 


Test 

Results 
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JIST 


Ground System Software 


HMI ( CCT S A IWCCT S E C LT PS E OPS Spacecraft JW1 Area: DEFAULT, Phase: DEFAULT, Role: Operations]! 



V Central Command 


Command Status 

TET [Disabled” 


FOP-1 State 
[ACTIVE 

FOP-1 State 
[ACTIVE 


Validation Bypass 

[Enabled | Disabled 3 

Validation Bypass 

[Enabled I Disabled 


GFSN FSN 
132 | 132 

GFSN FSN 


CECIL Information 
Status 


Currently Executing Proc 


Completed acsjno d e_co nf i g SCO# : O , 

The current time is 2015:063:19:47:36.582 
Time remaining: 90 seconds 
Time remaining: 60 seconds 
Time remaining: 30 seconds 


Time remaining: 60 seconds 
Time remaining: 30 seconds 
Time remaining: 0 seconds 
Test complete. 


- Writing Log Files... ~ 


Wr i t i n g RT log ( acs_t i s 2 00_1 v_s ep_rt L o g_2 01 5 - 03 - 04_1 9_4 9_3 6 . r ptjl . . . 

Writing telemetry report (acs_ti s200_l v_sep_ppTlm_2015 -03-04_19_49_36. rpt ) . 
Writing telemetry FOF report ... 

Logs saved. 

End of pro c . 
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Workbook - [NEW] 



A | 

B |c 


1 

Online SBC Current Spacecraft Time 

2010:365:00:47:27. 1( 
63 1 


2 

SPACECRAFT 



3 

SjC Minor Cycle Count 

52896 


4 

Online SBC CM M-S Interleave Depth 
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RT Selected Packet List 

7 


e 

Critical Data Packett List 

1 


7 

Engineering Data Packet List 

1 


8 

ISIM Data Packet List 

0 


9 

CLCW - lockout 

OK 


10 

VOQ -CLCW-FSN 

132 


11 

VC0 - CLCW -GSN 

132 


12 

VC0_FOP_ST ATE 

ACTIVE 


13 

VC1 - CLCW-FSN 

0 1 


14 

VC1 -CLCW - GSN 

0 


15 

VC1_FOP_STATE 

ACTIVE 


16 

CLCW Status Field 

No Fault Detected 


17 

C LC W FARM -B Cou nter {0-3} 

0 


18 

C LC W — retra n s m it 

OK 


19 

CMD Auth Ground Non -Contact Timer 

1323035 


20 

Online SBC Invalid Transfer Frame Flag 

x’0’ 
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COM MAN D COU NTER S 



22 

SBC ML Accept Counter 

0 


23 

SBC ML Reject Counter 

0 


24 

G->S/C SBC Cmd AcptCntr 

22 


25 

G -> S/C SBC Cmd RjctCntr 

0 

1 

26 

G-> S/C Pkt Accept C ntr 

132 

J 

1 

27 

G-> S/C Pkt Reject C ntr 

0 

J 

28 

SCS Cmd Accept Counter 

1 


29 

SCS Cmd Reject Counter 

0 

I 

30 

SCS -> JPIM Accept Count 

o : 


NASA 
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JIST 


Source An. 


ul_ -zsh 

— i nt . c- 
210 
211 
212 

213 

214 

215 
B+ 216 

217 

> r 

219 

220 
221 
222 

223 

224 

225 

226 

227 

228 




int high_byte; 
int bit; 
int irq = 5; 

unsigned int b = 0x80000000; 
unsigned int c = ~b; 

pri ori tyTabl eType pri ori ty2i nt ; 


pri on ty2i nt [i nt2pn on ty [l ] ] =i ; 


Breakpoint 1, main () at int. c: 218 
Cgdb) print priority2int 

SI = {0, 0, 2149022305, 1, 2149070080, 1, 2280064, 0, 1, 1, 2285940, 
0, 2280096, 0, 2148999132, 1, 4, 0, 0, 0, 0, 0, 0, 0, 2149563039, 
0, 2283136, 0, 2150442400, 1, 2280056, 0, 2149070080, 1, 1, 0, 
2149070080, 1, 2149069024, 1, 580, 0, 2150442368, 1, 1229148993, 
73, 2149000522, 1, 0, 0, 2147919440, 1, 239440, 6, 2280240, 0, 
239344, 6, 2280307, 0, 2280400, 0, 1, 0} 

Cgdb) 
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JIST 


Memory Analysis 


JIST - Mozilla Firefox 


f JIST 




& 193 ■ 16g.50.22 : SO 80/Sim ics/memor y/ 


» C Search 


☆ m + ft 4 & 


®ITC Memory Monitor 


Server Connection Status - 


lrtdtp+rtd#rti Ttlfl Up*Wl4Y 


Symbols (Wji) 


Symbol Panel 
Memory Spacer cipA_stje.phys_mem J 


Address 

Type 

Symbol 


0x001 3a 170 

R 

rormfs Image 

+ 

0x001 3af70 

ft 

romtelmageEnd 

+ 

0x001 3b2cc 

ft 

ACS 

+ 

0x001 3b2e4 

R 

ACS_Aclor:: ACS_MODE_TRANSITION S 

+ 

0x001 3b78c 

R 

ACS_ Actor :rtg_dass ^^Monitor Panel 

+ 


Monitors iA 

k ± 

plot_0 


Address 

Name 





OxOOSOdcaO 
OxOOSOdcaO 
OxOOSOel^O 
0x008 Del 90 

address 

Logger: © 


ACSSch#duler::mcCoLir11 

ACSSctiedUlsnrmeCcurrt 


ACSTl m ::sa£!R J$C RT (X,} 
ACSTlmsaZlR JSC RT [¥> 

name 




750 


900 850 



900 950 

) ACSTln: :saZIRU3CRT 





JIST — ► Orbit Scenarios 
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JIST— Utilizations 

30 day test 

Fine-Guidance Sensor Closed-loop 
Training 

Stored Command Procedure validation 
Stuck Thruster 

PPC fault injection (Instruction faults, etc.) 
Primary/Backup Swapping 
SUROM testing 



JIST— Findings 

Severity 1 issue found in Attitude Control 
Loss of mission 

Multiple issues found in telemetry formats and 
processing 

Multiple issues found in test drivers when integrating 
them with JIST 









Architecture 
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S3 gg| Overview 

Rolling out now to SLS IV&V Team 

Triplex Synchronization 

Integrates ARTEMIS models and dynamics 

Runs same qualification test as MSFC (Maestro) 

Similar capabilities to JIST 

Future goals: 

Integrate GSDO and MPCV software simulators for full 
system simulation. 




S3 fS Maestro Test Scenarios 


Main Window Test Case Control Message Viewer 


Current Test Info 


Values Editor CDSL Conductor FCCommandPassThrough 


FC1 Clear UF Chain 

FC1.FC2.FC3 Add 6204 to AF Chain 

FC1 Add 6636 to AF Chain 

FC1 Send Single Shot 6380 to AF 

FC1 Send Single Shot 15244 to AF 

FC1.FC2.FC3 Send Single Shot 13212 to UF 

FC1 Clear AF Chain 

FC3 Clear AF Chain 

FC1.FC2.FC3 Add 13212 to UF Chain 

FC2 Send Single Shot 29630 to UF 

FC3 Add 24271 to UF Chain 

FC1 Add 12683 to EF Chain 

FC2 Add 29649 to EF Chain 

FC3 Send Single Shot 31511 to EF 

I Enter Command Name or Pattern to Filter 


- Test Case Control 


Send Command 


Reload Commands 


Additional Info: 

□ Measurements 
0 Command Info 


Test Case IDs 


Run Publish Status 


l SINGLEBOX SIMICS ITC SLS H 


Description: 
Content ID: 


No description provided 
65281 


Transmission Rate: 0x0000 


Command Word: 0x0000 


Message Viewer 


[testers] (testers, I0_LAYER, lOLayer) INFO 0: Dev_l 553, testers, ############ Simulated KT Configuration for Bus - AF-3 ############### 
[testers] Waiting for "INITIALIZE" is taking a long time. Timeout occurring in "270" seconds. 

[testers] (testers, MODELS, CoreSim_SLS) INFO OxblO: CoreSim_SLS, ARTEMIS sim start (countdown clock) -70.0000 sec 

[testers] (testers, MODELS, CoreSim_SLS) INFO Oxbll: CoreSim_SLS, ARTEMIS sim start (simulation time) 2017-12-1 4T09:43:37.58002Z 

[testers] (testers, MODELS, CoreSim_SLS) INFO 0xbl2: CoreSim_SLS, ARTEMIS sim start (wall clock) 2015-09-1 7T19:48:16.68015Z 

[testers] (testers, IO_LAYER, lOLayer) INFO 0: Dev_GigE, testers, Device eth2 has IRQ: 16 

[testers] (testers, IO_LAYER, lOLayer) INFO 0: Dev_GigE, testers, Device eth2 has IRQ: 16 

[testers] Successful initialize!! 

[test_conductor] Successfully initialized ARTEMIS. 

[test_conductorj Successfully initialized ground emulator. 

[testers] Successfully issued getjojayer command 
[testers] Entering the startTest command 
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S3 IV&V Through Construction 

S3 presented challenges due to insufficient hardware 
documentation 

Extensive reverse engineering of FSW was necessary to 
build emulator 

Negative - Fidelity of hardware model 




S3 — Findings 

No specifics allowed © 

6 issues found in Board Support Package 

Most could only be validated using an all-software 
emulation 

■ Interrupt and timing related 

Bad states due to hardware failures 
IV&V is beginning test on application code now 




mmm 


Concluding... 

There are many ways to validate FSW 

Large NASA missions: 

Are difficult to fully validate 
Must work the first time 

ITC brings a unique capability to FSW testing 



